MEMORANDUM September 3, 2020 


TO: Jharrett M. Bryantt 
Executive Director, Innovation & Post-Secondary Programming 


FROM: Allison Matney, Ed.D. 
Officer, Research and Accountability 


SUBJECT: SUPPORTING COLLEGE AND CAREER READINESS OF MIDDLE SCHOOL 
STUDENTS THROUGH PROJECT EXPLORE IN HISD, 2019-2020 


Attached is a program evaluation of Project Explore. The program provided activities to foster 
positive academic mindsets of sixth-grade, seventh-grade, and eighth-grade students where 
college and career success is seen as attainable. Project Explore is aligned with meeting HISD 
District Goal 2, which is to improve the college and career readiness of high school graduates. 


Key findings include: 

e In 2019-2020, a total of 2,095 students were accepted for participation in the Project 
Explore program, and an additional 715 students were waitlisted for program participation. 

e In 2019-2020, a total of 62.9 percent (n=1,317) of all Project Explore participants completed 
a survey through the HISD HUB compared to 28.4 percent (n=203) of waitlisted students. 

e For program participants, grade eight students had the highest percentage of survey 
respondents who reported having either a strong growth mindset or growth mindset with 
fixed ideas (93.9 percent), followed by sixth grade (90.9 percent), and finally seventh grade 
(87.8 percent). 

e Project Explore participants, across all grades, missed fewer days of instruction, on average, 
than waitlisted students in all grades during both the 2018-2019 school year and the 2019-— 
2020 school year. 

e =In 2019-2020, both seventh and eighth grade Project Explore students experienced a 
positive difference in the number of students who met the benchmark on the RL360 math 
assessment at MOY compared to BOY (5 and 28, respectively). 

e On the RL360 reading assessment, both grade seven and grade eight accepted students 
experienced a positive difference in the number of students that met the benchmark at MOY 
compared to BOY during the 2019-2020 school year (4 and 1, respectively). 


Further distribution of this report is at your discretion. Should you have any further questions, 
please contact me at 713-556-6700. 
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BUREAU OF PROGRAM EVALUATION 


Supporting College and Career Readiness of Middle School Students through Project 
Explore in HISD, 2019-2020 


Prepared by: Kenneth L. Powers, Ed.D. 


Abstract 

Project Explore targeted minority students in grades six through eight who attended 28 Houston Independent School 
District (HISD) middle schools during the 2019-2020 academic year. In 2019-2020, a total of 2,095 students were 
accepted for participation in the Project Explore program, and an additional 715 students were waitlisted for 
program participation. The study measured students’ growth mindset to determine whether they perceived their 
academic talents can be developed. Over fifty percent of all program participants, regardless of grade level, reported 
having either a strong growth mindset or a growth mindset with fixed ideas. Project Explore program participants 
experienced fewer absences, on average, compared to waitlisted students. Further, there was a similar number of 
students who scored at/above the benchmark on the RL360 math and reading assessments when comparing 2019- 
2020 beginning of year (BOY) to the 2019-2020 middle of year (MOY) for both program participants and waitlisted 
students. Finally, the fewer absences for grade 7 students was the only independent variable that was statistically 
significant in predicting Project Explore participation. This evaluation was limited by the school closures related to 
the COVID-19 pandemic which forced Project Explore program activities to be limited to cohort meetings and 1:1 


advising in spring 2020. 


Background 

The Houston Independent School District (HISD) 
identified a gap in the percentage of high school 
graduates who met the Global Graduate standards as 
measured by the College and Career Readiness 
component of the Texas accountability system (Houston 
Independent School District, 2019). To eliminate or 
reduce this gap, HISD adopted District Goal 2 to increase 
the percentage of graduates meeting the Global Graduate 
Standards as measured by the College and Career 
Readiness component of the Texas accountability system 
(Houston Independent School District, 2019). 

HISD implemented Project Explore, which was 
designed to increase the college-going rates of middle- 
school students. Project Explore provides participating 
sixth grade, seventh grade, and eighth-grade students 
activities where college and career success is seen as 
attainable. The research has shown that developing 
students’ academic mindsets can play a significant role 
in improving students’ academic success in school 
(Blackwell, Trzesniewski, & Dweck, 2007). Project 
Explore is aligned with meeting HISD District Goal 2. 
To that end, this evaluation addressed the following 
questions. 


Research Questions: 

1. How did students who participated in Project 
Explore and students who were waitlisted assess their 
academic mindset? 

2. How did students who participated in Project 
Explore and students who were waitlisted differ in terms 
of students’ attendance in 2019-2020? 

3. How did students who participated in Project 
Explore and students who were waitlisted differ in terms 
of academic success on the Beginning of Year (BOY) 
and the End of Year of Renaissance Learning (RL360) 
reading and math assessments in 2019-2020? 


Limitations 

There were several data limitations to the study. These 
limitations were the result of HISD school closures on 
March 13, 2020, brought about by the COVID-—-19 
pandemic. First, the program only interacted with 
students from August 2019 through March 2020, and 
therefore were unable to fully implement the Project 
Explore program. Second, absence rates for the 2019- 
2020 school year were based on the number of days 
available for instruction before school closures. 


Therefore, the absence rates used in this report only cover 
the first 115 days of possible instruction for both the 
2018-2019 school year and the 2019-2020 school year. 
Finally, students completed one survey to self-report 
their attitudes toward education. The single survey 
provides only a snapshot of the students' attitudes toward 
education at that one moment in time. 


Project Explore 

The Project Explore program encompassed students in 
grades six through eight attending an HISD middle 
school campus. On each participating campus, there were 
cohorts of a maximum of 25 students at each grade level. 
Appendix A (Table 1), pp. 8-9, details the 
demographics of Project Explore students (students who 
received the intervention) and waitlisted students 
(students who met the criteria for inclusion but were 
waitlisted based on limited space). 


Project Explore Activities 

The number of activities and the types of activities 
scheduled by Project Explore in 2019-2020 differed by 
grade level. All grade levels were given one-on-one 
advising with all sixth-grade participating students 
having a single advising session, all seventh-grade 
participants being provided two one-on-one advising 
sessions, and eighth-grade participants having three one- 
on-one advising sessions. Participating students in all 
grade levels made at least one college and/or one industry 
visit during the 2019-2020 school year (Figure 1). 
Additionally, there were scheduled industry professional 
visits to program participating middle schools (one in the 
fall and one in the spring for 6th grade, one in the fall and 
one in the spring for 7th grade, two in the fall and two in 
the spring for 8th grade). Additional activities had all 
participating students, regardless of grade level, 
engaging in four topics for learning: Who Am I/Self- 
Discovery; Communication Skills; Goal Setting; and 
School Choice. School closures related to the COVID- 
19 pandemic forced Project Explore to stop the majority 
of program activities in spring 2020. For a more detailed 
listing of scheduled activities refer to Appendix B 
(Table 2), p. 10, and Appendix C (Table 3 through 
Table 5), pp.11-12. 


Social Skills 


Academic Perseverance 


Review of Literature 

The research has defined an academic mindset as the 
student’s attitudes, beliefs, dispositions about school and 
learning, and the relationship to academic outcomes and 
school success (Balfanz, 2009; Bassiri, 2014; Claro, 
Paunesku, & Dweck, 2016; Cook, Gas, & Artino, 2018; 
Hooker & Brand, 2010; Curry, Belser, & Binns, 2013; 
Dweck, Walton, & Cohen, 2014; Gaertner & McClarty, 
2015; Gysbers, 2013; Snipes & Tran, 2016). 
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Figure 1: Project Explore visits to colleges and career 
sites, fall 2019 


The academic behaviors adopted by students have been 
linked to a student’s academic mindset which is reflected 
in the social skills, academic perseverance, and learning 
strategies adopted by the student (Figure 2). Further, a 
student’s academic behavior is seen as being related to a 
student’s campus behavior. For example, when a student 
is persistent and fully engaged in learning they are more 
likely to attend school more often and have fewer 
disciplinary issues (Farrington, et al., 2012). 


Learning Strategies 


Academic Behaviors 


Figure 2: Mindset growth logic model, 2019-2020 
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Research has shown that a more negative academic 
mindset is related to a gap in the level of college and 
career preparation of high school students (Miller, 
Rudman, Hogman, & Gustavsson, 2016; Radcliffe & 
Bos, 2013; Snipes, Fancsali, & Stoker, 2012). This gap 
becomes greater when controlling for race/ethnicity, with 
Hispanic and African American students being less likely 
to meet benchmarks (i.e. grade point average, course 
completion, etc.) for college and career readiness. 
Further, fewer minority students than white students 
receive a regular diploma on-time with their ninth-grade 
cohort (Balfanz, 2009; Dweck, Walton, & Cohen, 2014). 

The academic mindset is viewed as being on a 
continuum between two ways of thinking about 
academics: fixed academic mindset and growth academic 
mindset (Bassiri, 2014; Blackwell, Trzesniewski, & 
Dweck, 2007; Claro, Paunesku, & Dweck, 2016; Cook, 
Gas, & Artino, 2018; Dweck, 2002; Radcliffe & Bos, 
2013). A student with a fixed academic mindset is 
defined as a student who is determined to prove how 
smart they are rather than improving their knowledge. 
Also, they believe their level of intelligence is 
unchangeable. By contrast, a student with a growth 
mindset views learning as a way to gain knowledge and 
that a person’s level of intelligence is malleable and can 
be increased. Research has shown that the middle school 
years are a fertile period to foster a growth academic 
mindset in students (Bassiri, 2014; Curry, Belser, & 
Binns, 2013; Curry, Belser, & Binns, 2013; Dweck, 
2002; Trei, 2007). A middle school student’s beliefs 
about education have been measured through surveys 
where student’s self-report on their academic mindset 
and data on the student’s campus behaviors is collected 
(i.e. attendance, and discipline) (Balfanz, 2009; Claro, 
Paunesku, & Dweck, 2016; Cook, Gas, & Artino, 2018; 
Dweck, 2002; Dweck, 2015; Miller, Rudman, Hogman, 
& Gustavsson, 2016; Curry, Belser, & Binns, 2013; 
Petrosino, Fronius, Goold, Losen, & Turner, 2017). 


Methods 
Study Population and Sample 

There was one study population in this program 
evaluation that attended one of 28 HISD middle schools 
in 2019-2020. The study population consisted of a total 
of 2,095 students across grades six through eight that 
were accepted for participation in the Project Explore 
program in 2019-2020. While the control group (n=715) 
consisted of students that met all criteria for participation 
in Project Explore but were waitlisted based on a lack of 
space. 


Data Collection and Analysis 

Data were collected using an online survey through the 
HISD HUB that was made available to Project Explore 
participants and waitlisted students. 
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The survey was opened on January 10, 2020 and was 
closed on March 6, 2020. For reliability, a Cronbach’s 
alpha of .837 was calculated for all fourteen survey items 
combined (Trobia, 2020). For more detailed information 
on Project Explore survey responses refer to Appendix 
D (Table 6 through Table 9), pp. 13-14. 

Project Explore participating students completed 62.9 
percent (n=1,317 of possible n=2,095) of the distributed 
surveys. Of all surveys completed by accepted students, 
the eighth grade had the largest percentage of students 
who completed the survey (66.9 percent, n=474). Of all 
waitlisted students, 28.4 percent (n=203) completed the 
survey. Of all surveys completed by waitlisted students, 
grade six had the highest percentage of completed 
surveys (32.6 percent, n=85). 

The survey provided information on respondents’ 
attitudes about academic and career success. Survey 
takers were placed into one of four groups based on their 
responses to the survey (minimum is zero and the 
maximum is 56). The four groups were: strong growth 
mindset (43-56); growth mindset with some fixed ideas 
(29-42); fixed mindset with some growth ideas (15-28); 
and strong fixed mindset (0-14) 
(MindsetQuiz.w.scores.pdf, 2020). 

The RL360 math and reading assessments provided a 
percentile rank for all Project Explore participants and 
waitlisted students in grades six through eight. Data for 
student performance was taken from two files: Star 
Reading (SR) and Star Math (SM). The percentile ranks 
for the BOY testing window in 2018-2019 (August 27, 
2018, through October 3, 2018) were compared to the 
MOY testing window (January 7, 2019, through 
February 1, 2019) percentile ranks. Additionally, the 
BOY testing window percentile ranks in 2019-2020 
(September 3, 2019, through September 24, 2019) were 
compared to the MOY testing window (January 6, 2020, 
through January 29, 2020). The percentile ranks were 
used to place test-takers in one of four categories: Tier | 
(At/Above Benchmark) for HISD test-takers that 
achieved at or above the 40th percentile rank score; On 
Watch for HISD test-takers that performed below the 
40th percentile rank score but greater than or equal to the 
25th percentile rank; Tier 2 (Intervention) for test-takers 
who performed below the 25th percentile rank score but 
greater than or equal to the 10th percentile rank; and Tier 
3 (Urgent Intervention) for test-takers who performed 
below the 10th percentile rank score. For more detailed 
information on RL360 math and reading assessments 
refer to Appendix E (Table 10 and Table 11), pp. 15— 
16. 

Demographic data for this report were retrieved from 
the 2019-2020 Management System Average Daily 
Attendance (PEIMS ADA) file. Students were enrolled 
in grades six through eight on an HISD campus who 
either participated in Project Explore or who were 
waitlisted. 


These include students’ highest-grade level, economic 
disadvantage status, English Language Learner (ELL) 
status, special education status, gender, and 
race/ethnicity. 

Finally, a binary logistic regression was performed, 
which allows for the testing of models to predict Project 
Explore program participation. The dependent variable 
was program participation (yes = 1 and 0 = no). There 
were five computed variables used in the binary 
regression. The first computed variable was the 
difference in the average number of absences between 
2018-2019 and 2019-2020. Two computed variables 
looked at the differences in student achievement on the 
RL360 math assessment between BOY and MOY testing 
windows for both 2018-2019 and 2019-2020. The final 
two computed variables were the differences in student 
performances on the RL360 reading assessment between 
BOY and MOY testing windows for both 2018-2019 and 
2019-2020 school years. 


Results 
How did students who participated in Project Explore 


and students who were waitlisted assess their 
academic mindset? 


Survey respondents were placed into one of four groups 
based on answers to the survey. 

Survey respondents with a strong growth mindset 
received total scores of 43-56. Respondents with a strong 
mindset with fixed ideas received total scores 29-42. A 
strong growth mindset is when a student sees levels of 
intelligence, skill, and success start at a basic level but 
with the capacity to grow compared to a student that 
reports having a growth mindset with fixed ideas where 
growth is seen as possible but the respondent reports not 
having the strategies to grow. 

As shown in Figure 3, for Program Explore students, 
grade eight had the highest percentage of survey 
respondents who reported having either a strong growth 
mindset or growth mindset with fixed ideas with 93.9 
percent, followed by sixth grade (90.9 percent), and 
finally, seventh grade (87.8 percent). For students that 
were waitlisted, sixth-grade survey takers reported the 
largest percentage having either a strong growth mindset 
or growth mindset with fixed ideas (93.0 percent), 
followed by seventh grade (92.5 percent), and finally 
eighth grade (90.8 percent) (Figure 5, p. 4). These 
percentages are tempered by the small number of survey 
responses of waitlisted students. 
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Figure 3: Self-reporting of growth mindset level for accepted and waitlisted students, 2019-2020 
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How did students who participated in Project Explore 
and students who were waitlisted differ in terms of 
students’ attendance in 2019-2020? 


Overall, Project Explore students in all grades had a 
smaller average number of days absent then waitlisted 
students in both 2018-2019 and 2019-2020 (Figure 4). 
As shown in Figure 3, all grades for both accepted and 
waitlisted students had a greater average number of 
absences in 2019-2020 when compared to 2018-2019. 
The largest difference in the average number of days 
absent between Project Explore students and waitlisted 
students were 1.7 days absent during the 2019-2020 
school year. For more detailed information on absences 
for Project Explore participants and waitlisted students 
refer to Appendix F (Table 12), p. 17. 


How did students who participated in Project Explore 
and students who were waitlisted differ in terms of 
academic success on the Beginning of Year (BOY) 
and the End of Year of Renaissance Learning 
(RL360) reading and math assessments in 2019- 
2020? 


As shown in Table 10 (p. 15), there was a positive 
difference in the number of Project Explore students in 
seventh and eighth that met the benchmark on the RL360 
math assessment at MOY when compared to BOY during 
the 2019-2020 school year (n=5 and n=28, respectively). 
Of all waitlisted grade levels, grade eight experienced a 
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positive difference in the number of students that met the 
benchmark on the RL360 math assessment at MOY when 
compared to BOY during the 2019-2020 school year 
(n=6). 

As shown in Table 11 (p. 16), Project Explore students 
in grade seven and grade eight both experienced a 
positive difference in the number of students that met the 
benchmark at MOY compared to BOY on the RL360 
reading assessment during the 2019-2020 school year 
(n=4 and n=1, respectively). By contrast, no grade level 
of waitlisted students experienced a positive difference 
in the number of students meeting the benchmark at 
MOY when compared to BOY on the RL360 reading 
assessment during the 2019-2020 school year. 


Binary Logistic Regression 

Binary logistic regression was performed to assess the 
impact of a number of factors on the likelihood that 
respondents participated in Project Explore during the 
2019-2020 school year. The model contained five 
independent variables (difference in total absences, 
difference in math 2018-2019, difference in math 2019- 
2020, difference in reading 2018-2019, and difference in 
reading 2019-2020). 

The full model containing all predictors was 
statistically significant for seventh-grade respondents 
only, x? (5, N = 546) = 13.39, p < .020, indicating that 
the model was able to distinguish between respondents 
who reported being a Project Explore participant and did 
not report being a Project explore participant. 


Waitlisted Accepted Waitlisted 
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Figure 4: Mean number of days absent for accepted and waitlisted students, 2018-2019 and 2019-2020 
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The model as a whole explained between 2.4% (Cox and 
Snell R square) and 3.7% (Nagelkerke R squared) of the 
variance in Program Explore participation status, and 
correctly classified 78.0% of cases. As shown in Table 
13 (p. 18), only one of the independent variables made a 
unique statistically significant contribution to the model 
(difference in total absences) recording an odds ratio of 
0.93. The odds ratio of 0.93 was less than 1, indicating 
that each additional day in the difference in absences, 
respondents were 0.93 times less likely to have 
participated in Project Explore, controlling for other 
factors in the model. 


Discussion 

In 2019-2020 a total of 2,095 students were accepted 
for participation in the Project Explore program, and an 
additional 715 students were waitlisted for program 
participation. A total of 64.6 percent (n=1,353) of all the 
Project Explore participants completed a survey through 
the HISD HUB. Of all the waitlisted students, 23.4 
percent (n=167) completed a survey through the HISD 
HUB. For Project Explore students, grade eight had the 
highest percentage of survey respondents who reported 
having either a strong growth mindset or growth mindset 
with fixed ideas (93.9 percent), followed by sixth grade 
(90.9 percent), and finally seventh grade (87.8 percent). 

Additionally, both Project Explore and waitlisted 
students experienced an increase in the average number 
of absences in 2019-2020 when compared to 2018-2019. 
Project Explore students had on average fewer absences 
during the 2019-2020 school year. This increase in the 
average number of absences could be explained by the 
uncertainty surrounding the Covid-19 pandemic. 

Furthermore, there was a positive difference in the 
number of Project Explore students in both seventh and 
eighth grade who met the benchmark on the RL360 math 
assessment at MOY when compared to BOY during the 
2019-2020 school year (5 and 28, respectively). On the 
RL360 reading assessment, Project Explore students in 
both grade seven and grade eight experienced a positive 
difference in the number of students that met the 
benchmark at MOY compared to BOY 2019-2020 
school year (n=4 and n=1, respectively). This increase in 
the number of Project Explore students who met the 
benchmark on RL360 assessments could be explained by 
the additional supports provided by Project Explore. 

Finally, the full model was predictive of between 2.4% 
and 3.7% of the variance in Project Explore participation 
for grade seven respondents. The differences in absences 
was the only independent variable that made a 
statistically significant contribution to the model. In other 
words, Project Explore students were more likely to 
have, on average, fewer absences. 

There were several limitations associated with the 
Project Explore program evaluation that resulted from 
the HISD school closures on March 13, 2020, brought 
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about by the COVID-19 pandemic. These limitations did 
not allow for a more robust evaluation of the 2019-2020 
Program Explore Program. 
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Appendix A 


Table 1: Project Explore Demographics for Accepted and Waitlisted Students, 2019-2020 


Total 2,810 1,584 56.4 1,226 43.6 
Accepted Total 2,095 1,170 55.8 925 44.2 
6 688 367 53.3 321 46.7 
7 698 387 55.4 311 44.6 
8 709 416 58.7 293 41.3 
Waitlisted Total 715 414 57.9 301 42.1 
6 261 139 53.3 122 46.7 
7 223 137 61.4 86 38.6 
8 231 138 59.7 93 40.3 


Source: 2019-2020 Project Explore; PEIMS ADA_ 2019-2020 


Table 1: Project Explore Demographics for Accepted and Waitlisted Students, 2019-2020 (continued) 


Total 2,810 1,027 36.5 1,663 59.2 41 1.5 55 2.0 16 0.6 
Accepted Total 2,095 801 38.2 1,211 57.8 31 1.5 34 1.6 14 0.7 
6 688 259 37.6 399 58.0 8 1.2 16 2 3 0.4 
7 698 267 38.3 397 56.9 13 1.9 14 2.0 7 1.0 
8 709 275 38.8 415 58.5 10 1.4 4 0.6 4 0.6 
Waitlisted Total 715 226 31.6 452 63.2 10 1.4 21 29 3 0.4 
6 261 70 26.8 177 67.8 3 1.1 8 3.1 2 0.8 
7 223 80 35.9 124 55.6 6 2.7 11 4.9 0 0.0 
8 231 76 32.9 151 65.4 1 0.4 2 0.9 1 0.4 


Source: 2019-2020 Project Explore; PEIMS ADA 2019-2020 
Note: * means Two or More or Native American 
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Appendix A (continued) 


Table 1: Project Explore Demographics for Accepted and Waitlisted Students, 2019-2020 (continued) 


een 


Grand Total ; 2,810 1,892 67.3 PGE 98.8 | 162 58 | 751 | 26.7 


Accepted Total 2,095 1,345 64.2 2,071 98.9 112 5.3 497 23.7 
6 688 435 63.2 681 99.0 44 6.4 177 25.7 
7 698 469 67.2 691 99.0 39 5.6 183 26.2 
8 709 441 62.2 699 98.6 29 4.1 137 19.3 
Waitlisted Total 715 547 76.5 706 98.7 50 7.0 254 35.5 
6 261 203 77.8 259 99.2 19 7.3 104 39.8 
7 223 166 74.4 218 97.8 10 4.5 73 32.7 
8 231 178 77.1 229 99.1 21 9.1 77 33.3 


Source: 2019-2020 Project Explore; PEIMS ADA_ 2019-2020 
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Appendix B 


Table 2: Scheduled Project Explore Student Interactions by Program Activity, 2019-2020 


Advising (All students) 
Advising (Cohort) 


Ensure all 8th-grade cohort students complete a PGP 
Ensure all 8th-grade cohort students complete a School Choice 
Cohort Expectations/Meetings application (if eligible) 


Curriculum (All students) 


Data Collection/Reporting 


Exposure nes ; <= : : 
Eight industry professional visits to the campus (1 in the fall and 1 in 


the spring for 6th grade, 1| in the fall and | in the spring for 7th 
grade, 2 in the fall and 2 in the spring for 8th grade) 


Partner Expectations Provide a space and guidance on the pull-out periods for Discover U 
to provide advising 


Recruit 75 students (25 at each grade level) 


Test Preparation 
(All students) 


Source: 2019-2020 Project Explore Program Activities, January 8, 2020 
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Appendix C 


Table 3: Scheduled Project Explore Advising Sessions Topics for Participating Students by Grade Level, 2019-2020 


Grade Level Advising Session 1 Topic Advising Session 2 Topic Advising Session 3 Topic 
oth Grade Nis Couns Choisedeiasuanans NIA NIA 
7th Grade Initial Project Explore Advisor Student Interview serene etiam teh N/A 
8th Grade nae Cae eee. Choice, College Super Mateh/ Postsecondary Choieds Sai Selection/Personal Graduation 


Source: 2019-2020 Project Explore Program Activities, January 8, 2020 


Table 4: Scheduled Project Explore Cohort Curriculum Objectives for Participating Students, 2019-2020 
Topic 1: Who Am I/Self- 


Lesson 3: Vision Board Activity 


Cohort Discovery Topic 2: Communication Skills Topic 3: Goal Setting Topic 4: School Choice 
; jee se é . s : i g 
Lesson 1: Who Am I? Lesson |: Flipping the Switch Lesson |: Roadmap to Success essen a aT Score and Magnet 
9). 4 7 . 
6th Lesson 2: Never Underestimate . Lessont3? What Dues Sucaees Mean te Lesson 2: CTE Choices and 
the Power of Positive Lesson 2: Oh, Puh-leeze —— Endorsement 
Grade Seo Aas ——_—————— Me? ———— + 
Mental Attitude aco 
Lesson 3: Changes, Choices, and ‘ Lesson 3: Navigating the Road to My Lesson 3: Time Management 
Lesson 3: Listen Hear! 
Lessons — Future 
< . *. ‘ ‘. “nn? : 
Lesson 4: Who Are the Copilotsin | Lesson 4: Quit Talkin’! [know what Lesson 4: SMART Goals Lesson 4: Interest Surveys 
My Life? to do! a 
Lesson 1: Who Do I Want to Lesson 1: Intention and Purpose of Lesson 1:Long-Term and Short-Term Lesson 1: What high school is right 
Become? Communication Goals for me? 
7th Lesson 2: Naviance Career Lesson 2: Sticks and Stones May Lesson 3: Hewothelical <eeiariog Lesson 2: What high school is right 
ee gaara s : Hyp 
Grade Cluster Finder Survey Break My Bones... 


for me? (Continued) 


Lesson 3: Types of Communication 


Lesson 3: Hypothetical scenarios Part 


Lesson 3: Endorsements 


I 
Lesson 4: Vision Board Activity ecco de Aneen Dn Lesson4 :Hypothetical Scenarios Part Lesson 4: Magnet eligibility 
continued ~ ‘ areeneeay it requirements 
Lesson 1: Imagining My Future: iGsanon 12 Save ca Comiuiente Lesson 1: What Does Success Mean to Lesson 1: Understanding the 5 High 
Dream a Little Dream ——————eeee Me? School Endorsements 
8th essen So Sale iscover iiesson 2 Develapine Sult Slalis Lesson 2: Developing S.M.A.R.T. Lesson 2: Which High Schools can I 
Grade sehen vevetoping somes’ Goals apply to? 


Lesson 3: True Colors: Exploring 
Who I Am 


Lesson 3: Developing Soft Skills 


Lesson 3: Informed Decision-Making 


Lesson 3: College Research 


Lesson 4: Vision Board Activity 


Lesson 4: Understanding 
Directions: Quit Talkin’! I 
know what to do! 


Source: 2019-2020 Project Explore Program Activities, January 8, 2020 
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Lesson 4: Informed Decision-Making 
(Continued) 


Lesson 4: College Research 
(Continued) 
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Appendix C (continued) 


Table 5: Scheduled Project Explore College and Career Readiness Training Objectives for 


Grade 7 and Grade 8 Participating Students, 2019-2020 


7th Grade 8th Grade 
Training My 
Module exes Personal 
OnCourse A 
Highway 

Students will identify their personal suse Mies oe ee th 
interests and how they relate to your P ene * nee ee h mi cy 
high school, college and career eee 

Module 1 Who Am I? : ; Who Am I? | college and career planning. 

planning. The student will complete The student will lete th 

the Cluster Finder or Career Key in ee ee 

Nance Cluster Finder or Career Key in 

: Naviance. 

Students will relate interests to career eee : 

clusters and programs of study. The baal asain ecco 

student will recall strategies for j : ae 

: : to selecting a high school. 
exploring career choices. Students Sen meen enter: 
Investigating will identify available resources for High School : : : 
Module 2 : See é high schools according to their 
Career Clusters | investigating career choices, relate Research Sai caualner 

career goals with career learning nee i re aire : 

experience opportunities, and identify a fh ea na sae 

education and training requirements ay a ee st 

for career choices. ee 

Students will recognize the career Students will explore 

clusters and programs of study within endorsements and career 

Padecandin each endorsement area, learn how Careae pathways that are offered at 
qd ; ‘ : : : 
the Rive High career interests align with Patan each high school. Students will 
g ‘ ; 

Module 3 School endorsement selection, describe how ana Hike ni understand how to choose the 
Le ere to choose, change and/or add an Choice best fit high school. Students 
oe endorsement, and identify the pitfalls will be able to compare 

to graduating without an subjective and objective 
endorsement. information about high schools. 
Students will be guided through 
the components of the PGP to 
Personal prepare for completion in 9th 
Module 4 N/A Graduation grade. Students will connect 
Plan (PGP) their personal interests with 


high school planning and 
school choice. 


Source: 2019-2020 Project Explore Program Activities, January 8, 2020 
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Appendix D 


Table 6: Project Explore Survey, 2019-2020 


How true are the following about you? * (a = .788) 

My intelligence (ability to acquire and apply knowledge and skills) is 
something that I can't change very much. 

Challenging myself won't make me any smarter. 

There are some things I am not capable of learning. 

If I am not naturally smart in a subject, I will never do well in it. 

In typical class, how true are the following? (a = .815) 

I don't participate in discussions because I am afraid people might 
think I am foolish. 

I would rather do easy work that I can do well than challenging work 
where I might learn more. 

I don't ask questions in class because people might think my questions 
are not smart. 


I stop doing work if I feel like I can't do it well. 
I only volunteer to answer a question if I am sure my answer is right. 
In a typical class, how often do you: (@ = .773) 
Do the readings or other assigned work to prepare for class. 
Turn in assignments on the due date. 
Actively participate in class. 
Have all my class materials with me. 
Do more than what is expected. 
Scores of Growth Mindset (Overall a = .837)_ 
Source: 2019-2020 Project Explore Survey 


Strongly 
Agree 


1 


Note: * Reverse code for the degree to which the student reports a Growth Mindset. 


Agree 


2 
Seldom 


2 
2 


2 


2 

2 
Seldom 

2 

2 


Disagree 


Table 7: Students Self-reported Level of Growth Mindset on Project Explore Survey, 


Strongly 
Disagree 


4 


PAI PAIL) 
Strong Growth Mindset 43-56 
Growth Mindset with some Fixed ideas 29-42 
Fixed Mindset with some Growth ideas 15-28 
Strong Fixed Mindset 0-14 


Source: Adapted from - MindsetQuiz.w.scores.pdf, 2020 
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Appendix D (continued) 


Table 8: Percentage of Completed Surveys for Accepted and Waitlisted Students, 2019-2020 


Source: 2019-2020 Project Explore Survey 


Table 9: Self-assessment of Growth Mindset for Accepted and Waitlisted Students, 2019- 
VIVAL) 


Accepted 427 100.0 416 100.0 474 100.0 
Strong Growth Mindset 183 46.6 180 43.3 251 53.0 
Growth Mindset with Fixed Ideas 205 44.3 185 44.5 194 40.9 
Fixed Mindset with Growth ideas 30 7.4 42 10.1 26 5.5 
Strong Fixed Mindset 9 1.6 9 2.2 3 0.6 
Waitlisted 85 100.0 53 100.0 65 100.0 
Strong Growth Mindset 35 41.2 23 43.4 33 50.8 
Growth Mindset with Fixed Ideas 44 51.8 26 49.1 26 40.0 
Fixed Mindset with Growth ideas 5 5.9 3 5.7 5 77 
Strong Fixed Mindset 1 1.2 1 1.9 1 15 


Source: 2019-2020 Project Explore Survey 
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Appendix E 


Table 10: BOY and MOY RL360 Math Tier Group for Accepted and Waitlisted Students, 2018-2019 and 2019-2020 


2019-2020 2018-2019 2019-2020 
Participation Status Shae Wee BOY MOY Difference BOY MOY | _ Difference 
At/Above Benchmark 330 336 6 299 276 -23 
6 On Watch 66 58 -8 re: 78 1 
Intervention 71 76 5 69 72 3 
Urgent Intervention 55 52 -3 77 96 19 
At/Above Benchmark 293 282 -11 283 288 5 
Receated 7 On Watch 72 70 -2 74 78 4 
Intervention 82 719 -3 87 76 -11 
Urgent Intervention 64 80 16 67 69 2 
At/Above Benchmark 328 338 10 339 367 28 
8 On Watch 80 76 -4 84 80 -4 
Intervention 67 62 -5 59 50 -9 
Urgent Intervention 52 51 -l 45 30 -15 
At/Above Benchmark 102 105 3 81 78 -3 
6 On Watch 25 28 3 32 28 -4 
Intervention 24 23 -1 32 31 -l 
Urgent Intervention 30 25 -5 36 44 8 
At/Above Benchmark 66 67 1 68 64 -4 
sy On Watch 22 27 5 25 25 
Wartisted i Intervention 29 17 =D 25 24 zi 
Urgent Intervention 27 33 6 26 31 
At/Above Benchmark 83 89 6 86 92 6 
8 On Watch 24 23 -1 27 30 
Intervention 32 27 -5 31 20 -11 
Urgent Intervention 22 22 0 17 19 
Total 2,046 2,046 0 2,046 2,046 0 


Source: 2018-2019 RL360 Math file; 2019-2020 RL360 Math file 
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Appendix E (continued) 


Table 11: BOY and MOY RL360 Reading Tier Group for Accepted and Waitlisted Students, 2018-2019 and 2019-2020 


2019-2020 2018-2019 2019-2020 
Participation Status Hess Bee BOY MOY Difference BOY MOY Difference 
At/Above Benchmark 181 191 10 175 142 -33 
6 On Watch 88 103 15 85 104 19 
Intervention 115 97 -18 117 84 -33 
Urgent Intervention 128 121 -7 135 182 47 
At/Above Benchmark 146 149 3 141 145 4 
Aeveatea 7 On Watch 90 85 -5 111 112 1 
Intervention 145 118 -27 119 90 -29 
Urgent Intervention 140 169 29 150 174 24 
At/Above Benchmark 197 190 -7 185 186 1 
8 On Watch 101 97 -4 116 127 11 
Intervention 130 129 -1 123 96 -27 
Urgent Intervention 128 140 12 132 147 15 
At/Above Benchmark 41 46 5 36 34 -2 
6 On Watch 33 37 4 31 41 10 
Intervention a2 52 0 41 22 -19 
Urgent Intervention 67 58 -9 85 96 11 
At/Above Benchmark 35 33 -2 30 30 0 
ea On Watch 18 20 2 25 26 1 
Warslisted ‘i Intervention 32 37 5 33 oi ay 
Urgent Intervention 61 56 -5 58 69 11 
At/Above Benchmark 34 30 -4 34 34 0 
8 On Watch 24 26 2 27 35 8 
Intervention 54 47 -7 40 28 -12 
Urgent Intervention 46 55 9 57 61 4 
Total 2,086 2,086 0 2,086 2,086 0 


Source: 2018-2019 RL360 Reading file; 2019-2020 RL360 Reading file 
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Appendix F 


Table 12: Mean Absences for Accepted and Waitlisted Students, 2018-2019 and 2019-2020 


Accepted 1,951 3.6 1,853 4.12 
6 621 2.9 592 3.36 
7 658 3.9 627 3.97 
8 672 3.9 634 4.56 
Waitlisted 647 4.5 586 5.07 
6 243 3.4 220 5.08 
7 194 4.9 175 5.67 
8 210 5.5 191 4.58 


Source: SIS ad hoc_2018—2019 and 2019-2020 Attendance file 
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Appendix G 


Table 13: Logistic Regression Predicting Likelihood of Reporting Participation in Project Explore by Grade Level, 2019-2020 


B SE. Wald df 7 Odds Ratio 95.0% C.I. for Odds Ratios 
Upper Lower 
Difference in Absences -0.04 0.02 2.72 1 0.10 0.96 0.92 1.01 
Difference in math 2018-2019 0.00 0.01 0.02 1 0.90 1.00 0.99 1.01 
eiee Difference in math 2019-2020 0.00 0.01 0.81 1 0.37 1.00 0.99 1.01 
Difference in reading 2018-2019 -0.01 0.01 0.85 1 0.36 0.99 0.98 1.01 
Difference in reading 2019-2020 0.00 0.01 0.22 1 0.64 1.00 0.99 1.01 
Constant 1.03 0.10 99.63 1 0.00 2.81 
Difference in Absences -0.07 0.03 7A5 1 0.01 0.93 0.89 0.98 
Difference in math 2018-2019 -0.01 0.01 2.03 1 0.15 0.99 0.98 1.00 
Grade 7 Difference in math 2019-2020 0.01 0.01 1.05 1 0.31 1.01 0.99 1.02 
Difference in reading 2018-2019 -0.01 0.01 1.90 1 0.17 0.99 0.97 1.01 
Difference in reading 2019-2020 -0.01 0.01 1.46 1 0.23 0.99 0.98 1.01 
Constant 1.37 0.11 144.87 1 0.00 3.92 
Difference in Absences 0.03 0.03 1.05 1 0.31 1.03 0.98 1.08 
Difference in math 2018-2019 -0.01 0.01 1.91 1 0.17 0.99 0.98 1.00 
Giada Difference in math 2019-2020 0.01 0.01 1.51 1 0.22 1.01 1.00 1.02 
Difference in reading 2018-2019 0.00 0.01 0.11 1 0.74 1.00 0.99 1.02 
Difference in reading 2019-2020 -0.01 0.01 1.14 1 0.29 0.99 0.98 1.01 
Constant 1.18 0.10 130.75 1 0.00 3.26 


Source: SIS ad hoc_2018—2019 and 2019-2020 Attendance file; 2018-2019 RL360 Math file; 2019-2020 RL360 Math file; 2018-2019 RL360 Reading file; 2019-2020 
RL360 Reading file 
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